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ABSTRACT , 

, ' Tiie author has developed a model for trans^f^rring and 

implementing educational innovations from one institution to another. 
The model consists of an organized set of variables whose precedence 
relatibnships were determined by statistical analysis of collected 
data* A questionnaire was sent to a sample of prospective consumers 
of educational technology. Using their responses to the 
questionnaire, several forms of multivariate statistical analysis 
were used to determine which factors were important to consumers. 
These factors were then used for the design of a data collection form 
for innovation developers, and the foundation for the design of a 
data management system. (Author/CH) ^ 
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Abstract 

Prior to this document very little work had been done in the 
field of transferring and Implementing educational innovations from one 
Institution to another. Most of the work which had been done previously 
approached the problem from the innovation developer's point of view. This 
paper adopts the opposite, that is the consumer's, point of view. 

A questionnaire was sent to a sample of prospective consumers. 
Using their responses to the questionnaire, several forms of multivariate 
statistical analysis were used to determine which factors were Important to 
them. These factors were then used for (1) the design of a data collection 
form for Innovation developers, and (2) tf^e foundation for the design of a 
data base for a data management system. 
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Purpose of This Thesis 

The purpose of this thesis is the derivation of a model which will 
be used in four distinct, yet closely related, ways. It should be noted here, 
however, that the term "model" is not being used in its normally accepted 
sense. The "model" is not a mathematical model, which predicts, given a set 
of inputs, a normal response plus or minus an error term. Instead the "model" 
is an organized set of variables whose precedence relationships were determined 
by the statistical analysis of collected data. 

The first use of the model was for the design of data collection 
forms to be used specifically for research in education. One of the major prob- 
lems in all research today is the recognition of what data are important early 
enough in the project, such that those data are not lost. One solution to this 
problem is to collect and save all the data possible. Then, at the end of the 
project, all.the data, important and unimportant, must be carefully analyzed 
and separated. Another, possibly better, solution is to determine ahead of 
time what items of data will be important and capture only those items. 

The second and third uses of the model are related to the consumer. 
The prospective consumer will be able to use the model, first, for evaluation 
of an educational innovation and, second, for determination of necessary 
changes, if any, required to transfer and implement this innovation at his or 
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her educational institution. A consumer must be wary of making two types of 
mistakes. Assume he has be^n given. data upon which to make his evaluation^ 
and the data are not what he was interested in. Then the first error would be 
to reject an Innovation when it was a very good one. The second error would 
be to accept an innovation which was not good. These two errors are similar 
to Type I and Type II errors in statistical hypothesis testing. (27) Use of this 
model will hopefully minimize the possibility of these two types of errors, 

4 

since derivation of the model depends upon prospective consumer inputs. 

T!ie fourth use of the model is for the foundation of a data base 
which will be used in conjunction with a management information system. This 
management information system will present, quickly and efficiently, the 
information which the consumer nedds to employ to make his evaluation. A 
listing of the program and an example output are included in Appendix H . 

The four previously mentioned uses of the model are closely related 
to one main goal. That goal is to maximize the probability that worthwhile 
educational innovations will be accepted and used by other institutions. To 
meet that goal, the necessary information must first bo, collected and then 
disseminated to the prospective consumer in an orderly fashion. 

The Organization of the Thesis 

The Introduction to and organization of the thesis are presented 
in Chapter 1. Chapter II presents a review of literature pertaining to the 



transferring and implementation of educational innovations. Chapter III 
presents the hypothesized model along with a discussion of methods for 
collection of data. The analysis of the data and analytical techniques are 
presented in Chapter IV. The results and conclusions, along with suggestions 
for extensions and recommendations for further research, are provided in 
Chapter V. 
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- CHAPTER II 
LITERATURE REVIEW 

Introduction 

This chapter presents a short summary of the work which has been 
ctone in the past regarding educational innovations and their adoption or 
Implementation by an educational institution. It presents several important 
considerations such as the necessary steps in and obstacles to change in 
institutions. The important concept of innovation is defined in this chapter 
also. Finally^ a practical approach is presented, using the model mentioned 
in Chapter I, along with a discussion of its merit. 

The Problem 

The first step In this type of endeavor is a complete and concise 
definition of the problem. Basically, it is a problem in marketing, specifically 
custorher acceptance. Given that a company has developed a new J|roduct for a 
very specific market, what factors will determine the acceptance oj* rejection 
of the product by the customers, and which of these factors are most important"^ 
In our case the new product is an educational innovation and the customers 
are educational institutions. From the customer's viewpoint, the problem is 
slightly different. The problem is how to efficiently and effectively evaluate 
the new product, minimizing the probability of making the two types of errors 
mentioned In Chapter I. Both problems are related, however. The common 
point of both problems is "What are the factors?" 
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What is An Innovation? > 

Miles {25, 26) defines an innovation as "a deliberate, novel, 
specific change which is thought to be more efficacious in accomplishing the 
goats of a system." He goes on to define a system as "a bounded collection of 
^Interdependent parts, devoted to the accomplishment of some goal or goals, 
with the parts maintained in a steady state in relation to each other and the 
environment by means.of (1) standard modes of operation, and (2) feedbacks 
from the envlrc^nment about the consequences of systems actions 

This definit|on^of^ system seems to fit ao educational system very 
well. The Interdependent parts are the different colleges, departments, and 
teachers. The goal of all three parts is to provide an opportunity for education 
In the best manner possible. The interdependency of the parts is very obvious^^ 
The environment would be the student body. The steaiJy state relationship 
between the parts and the environment is the hierarchy of the educational system 
which goes from student up to administrator. Feedback from the environment 
comes in several forms. One form which was popular in the late 1960's was 
protest. A second type is the teacher evaluation forms which are administered 
at the end of each semester. Other types of feedback are student comments and 
student interviews. These often are used after a new type of course is taught 
or after a new method of teaching an old course is used. 

Educational Innovations range from new textbooks to entirely new 

. i 

courses. Often, the development of a new course is made possible by advances 

In other areas such as computer technology. For example, a course in pipeline 
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design or stfueture of bridges might be developed in which the student "draws" 
the pipeline or bridge on a graphics terminal using a light pen. Also, develop- 
ment of new courses is made possible when costs of new technology become 
feasfble. The previously mentioned course in pipeline design could have been 
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developed ten years ago but the cost of the equipment would have made it 
Infeaslbie. Many innovations are not complete courses ^ but instead ''re computer 
based supports which are used in conjunction with existing courses to help the 
student learn the material better and eliminate student and faculty tedium. For 
example, a^ course in statistics might have a computer-based support package 
which. aids the student in discovering vital facts about different types of distri- 
butions simply by displaying those distributions and asking the student leading 
questions. This development would be enhanced by the fact that the cost for 
computer "line time" has decreased drastically in the past few years. Another 
type of innovation might be to take an existing course taught by the traditional 
means and change the teaching strategy such that the course becomes self-paced. 
These are only three of the many possible innovations In educational technology. 

Steps in Change 

What steps are necessary for change in general? Cooper (10) says 
that traditional curriculum change/Znvolves: 

1) evaluation of the/ current program 

2) review of research literature for better materials 

3) development of a revised course of study and materials 

jl3 



4) acquisition of materials and equipment 

5) in-service training 

6) introduction and feedback. 

This is fine for development of an innovation for oneself only. However, what if 

1 

development was intended for widespread dissemination? Steps 1 through 3 
would be appropriate for the developer.of the innovation . If a step 3 . 5 were 
inserted for evaluation of an innovation developed elsewhere, then steps 3.5 
through 6 might be appropriate, for a consumer. 

Callah^r (14) defines a "culture change cycle" in three stages: 

1) innovation: the process whereby a new element of 
culture is made available 

2) dissemination: the process whereby an innovation comes 
to be shared 

3) integration: the process whereby an innovation becomes 
mutually adjusted to the other elements of the system. 

Process 1 has to do with the developer of the innovation exclusively. Process 3 
has to do mainly with the consumer>^ However, Process 2 has to do with both 

the innovator and the consumer, and the important question becomes how to 

i 

make that interface a success for both parties. 
Obstacles to Change 

Carlson (6), Wiley (32), and McAndrew (24) seem to/adopt a similar 
attitude in dealing with the subject of obstacles to change. That is, they put the 
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blame for non-adoption on the consumer. Their prevalent attitude is that if the 
consumer did not accept an innovation then he or she is at fault and would not 
recognize a good innovation regardless of its merit. This might be correct in a 
small percentage of the cases, but surely not in general. 

Jenks (18) presents a fairly good model of a system and an innova- 
tion. (See Figure 1.) He then used regression analysis on the antecedent to try 
and discover the factors relating to adoption or non-adoption of an innovation. 
Thisjs a highly commendable effort but it attacks the problem from the wrong 
^nd. the "Actor's Identity" factors that he identified relate to the consumer and 
not the innovation. It seems that he is also trying to put the blame for non- 
adoption on the consumer. Perhaps people who feel this way also think they 
should go out and qhange the consumer to fit their innovation, which is not a 
very feasible approach. 

No one mentions that the fault could lie with the developers of the 
innovation. Could it be that the consumer rejects an innovation because he or 
she was not given the information upon which to make a sound judgement 
regarding the merits of the Innovation? Or, if the consumer was giv6n information 
might It have been the wrong information, which in turn caused the consumer to 
reject the innovation? This ide^a about information definitely has to be considered 

a main factor or cause of acceptance or rejectance of an innovation/ 

^ / 

Another obstacle to change might be the lack of necessary physical 
facilities. Closely related to this is the problem of budget. Can^the consumer's 
Institution afford to acquire the necessary equipment? If not, surely he or she 
will reject the innovation no matter how good it is or is not. A third obstacle 
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might be that the administration is tied to traditional methods of teaching and is 
highly skeptical of innovations. This in turn would indicate that the financing 
necessary for the innovation would be difficult to get, thereby causing rejection. 
Jenks (17) hints at the three above factors in his model under the heading 
^^Perceptions of the Situation." These three factors nevertheless, cannot be 
influenced by anyone outside the consumer's institution and, therefore, are not 
Important to the developer of an innovation. 

\ 

Diffusion . 

/ 

\ Carlson (6) says "diffusion literature is as sophisticated and as 

well-developed as any other areas of scientific study to which educators have 
given their attention." This is probably not completely correct because the 
literature concerning diffusion and the relationship between the supplier and 
the consumer seems to bear no real relationship to the practical problems of 
getting an innovation diffused or spread out. This would imply that the oppor- 
tunity for. much more research in this area exists. 

Practical Approach 

The only practical way to approach the problem is from the consu- 
mer's point of view. If the developer of an innovation anticipates the consumer*s 
every need and can answer most questions that he might ask concerning an 
innovation he will stand a much greater chance to "sell" his product. 

Miles (25) lists five questions for a consumer to ask himself: 

1) What is the innovation? 

2) What changes are necessary for adoption? 
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3) What equipment and materials will be needed? 

4) How much and what type of In-service training Is required? 

5) Whatjare the mechanisms for evaluation and feedback? 
These are important questions which must be answered prior to adoption of the 
innovation. 

Lippitt (20) also proposes some necessary steps for resource 



adoption: 



\ 

1) A review of alternatives by appropriate decision makers. 



2) Study validity of resources used in developmental stages. 

3) Set up a plan to test alternatives and feasibility. \^ 

4) Analyze needs for in-service training and adoption. 
Butts (5) comes closer to identifying many of the important 

requirements for change than anyone else: 

1) Setting of the school must be receptive to change 

2) Essential materials and facilities 

3) Adequate time and guidance for planning and analysis 
- 4) In-service traming 

5) Users* meeting 

6) Materials budget \ , 

\ 

7) In-service training time ^ 

8) Mailing Hst for revision ?hd change^ 

9) Sufficient rewards for the implementor. 
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Summary 

In summary, most of the literature available was disappointing. 
Much of It sounded good superficially such as Cooper's "Initiating Educational 
Change/ only to be vague and without any suggestions for practical application 
Only a few people such as Llppltt (20,^21), Miles (25, 26), Butts (5), .^nd 
Jenks (18) deal with any of the practical considerations which have to be made 
In transferring and Implementing an educational Innovation. Jt seems obvious 
that the consumer's point of view should be taken into account if the Implemen- 
tatlon of the innovation Is to be a success. 
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Introduction 



CHAPTER III 
THE EXPERIMENT 



It was determined that, to identify those variables or those factors 
which were important to both the developers and the consumers of Innovations, 
an experiment must be set up and carried out. The first step was to have some 
developers of innovations, along with the author, hypothesize a set of variables 
for the model . The developers chosen were the members of the Implementation 
Model Committee of Project C-BE. Each of the hypothesized variables fell 
into one of five major categories. Those categories were: 

1) Nature of the Course 

2) Resource Requirements 

- 3) Benefits on a Comparative Basis 

4) Commitment of Supplier and Consumer 

5) Itmplementation Procedures, 

The ordering of the categories is not meant to indicate any order of importance. 
Next a questionnaire was formulated usfng the hypothesized variables as a 
foundation. The questionnaire was then sent to random faculty and adminis- 
trators all over the country to gauge their reactions. I am now going fo discuss 
the five categories. 



* Project C~ BE: Computer-Based Science .and Engineering Education, is a 
four year effort funded by the National Science Foundation, (EP-17/7/11/73) . 



Nature of the Course 

This category was thought to be Important because It contains many 
of the details regarding the innovation. Five main variables suggested under 
this category were: 

1) objectives of the course 

2) description of the course 

3) detailed course outline 

4) student prerequisites 

5) history of the course. 

These variables all deal with a specific course. This Is because very fgw 
Innovations are general enough to be used with any course, unless the innovation 
is something like a new teaching method, such as self-paced instruction, or a 
computer-based record keeping system. 

The variable "objectives of the course" includes Ideas such as 
grade level of the course and the level of the material presented in the course. 
It would be important to know whether the course was intended to be taught as 
a remedial course, an undergraduate course or a graduate course. Closely 
. related to grade level is the level of the material. The level of material signified 
, whether the course was meant to give the students an introduction to the material 
or a deefier understanding of material to which they had been previously exposed. 

Also included under this variable is the important consideration of whether the 

• • •»* 

objectives of the course can be modified to meet someone else's needs. A 
consumer from the discipline of psychology might need a graduate level statistics 



course and might be able to use one developed for engineering students if the 
objectives could be modified slightly. 

The variable "description of thfe course" takes into account the 
Important ideas of course content, teaching method, pedagogical strategy, 
availability of special materials, and reference materials. Reference materials 
let the consumer know which books were used for texts and outside references. 
Content of the course tells the consumer how much material and, in particular, 
which ideas and concepts were covered in the texts and the references. It also 
indicates in how much detail the material was covered. The availability of 
special materials has to do with the developer furnishing materials such as 
computer programs and Instructions for their use. The term "special" 
materials implies that the materials are not commercially available. It was also 
deemed important to know what the pedagogical strategy or teaching method was. 
A course taught by the self-paced method can be quite different from the same 
course taught by the more traditional approach of in-class lectures. 

The third variable was "detailed course outline." This is important 
in case there is some Inherent advantage to teaching material in a specific order. 
Some concepts may need to be taught first as a background for other concepts 
taught later. This might enhance the ability of the student to understand the 
material . 

The fourth variable was "student prerequisites." Depending on the 
level of the course, it may be to the student's advantage to have had background 
In other areas. Sometimes this background may be recommended and other 
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times it might be required. Also, the prerequisites may bemused to limit the 
size of the class, if that is important. 

The fifth variable was **history of the course." Included in this 
variable are ideas such as overall evaluation of the course, evaluation procedures 
publications, and student feedback. The consumer might very well want to know 
how the course was evaluated, and why it was evaluated a certain way. If the 
consumer wanted a descriptive account of the course, and was unable to visit the 
Institution of the developer, then he might read any publications which had come 
about due to the course. Student evaluation of the course would probably be of 
Interest to the prospective consumer also. 

Also, Implicitly included in the five variables mentioned previously. 

Is the notion of whether the values of the variables can be modified. This is 

J 

Important in the same way as it was discussed under "objectives of the course. " 
Resource Requirements 

Included in this category, five variables were identified. They are: 

1) faculty and staff requirements 

2) physical plant requirements 

3) budget requirements 

4) material requirements 

5) computing requirements.' 

Once again, no precedence relationships are intended by the ordering of the 
variables. 




The first variable was "faculty and staff requirements." The impor- 
tance of this variable would not opiy be in costs but also In faculty manpower 
requirements. A school might be looking for a course which could be taught by 
an instructor or a teaching assistant instead 9f a professor due to a shortage of 
faculty. It would also be important to know whether these requirements were 
rigid or flexible. 

I The next variable is "physical plant requirements." A consumer 
would certainly want to know how many studehts the course was designed for in 
order to more efficiently plan the use of classrooms. It would also be imperative 
to know whether the course required a specialized lab or not. Some consumers 
ntlght be Interested In the course if the lab could be modified or eliminated* 

r 

The variable "budget requirements" is of obvious importance 

to the consumer. What school has an unlimited budget to use as they see fit? 

Included in this topic are expenditures for special materials or equipment such 

as teletypes or graphics terminals. Other expenditures are for faculty relief 

time, graders, and proctors. Another expenditure could be for computer time 

a 

used by students. The total cost^of Implementation Is also an important, one-tlrfie 
only expenditure. 

"Material requirements" is the same variable as the previously 
mentioned "availability of special materials." Many variables such as this one 
overlap Into seVeral categories. 

The last variable in this category Is "computer requirements." 
This is important only If the Innovation depends heavily on the computer. If the 
course is taught on the computer, such as the earlier rnentloned pipeline design 
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course, the computer resources will be very important. It may mean that the 
consumer will have to buy or rent additional hardware to supplement any 
existing hardware that his institution already has. This would certainly be an 
Important consideratl^^ This variable includes areas such as the amo.unt of 
computing time required per student per semester. Also special materials 
produced on a certain type of computer may not be easily transferred to another 
lype-of computer. 

Benefits on a Comparative Basis 

The "benefits on a comparative basis" will be an area about which 
a prospective consumer will be particularly concerned. The benefits are 
divided Into three main^areas or variables. They are: 

1) benefits to the student 

2) benefits to the teacher 

3) benefits to the institution. 

Probably no innovation will have all the hereafter mentioned benefits but every 
innovation should have a few of them. 

There are several ways a student may benefit from the use of an 
Jnnovatlon. The first benefit would be to learn and remember more material. 
The innovation may increase teaching efficiency such that more material is 
covered more effectively than another method of teaching. Thus, the students' 
learning effectiveness and retention of knowledge would be enhanced. Another 
benefit might be less time required of the student by the course. A course 
uslng,a self-paced method of instructing makes It possible for a student to cover 
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material at his own pace. Thus, most students would need to spend less time 
on easy concepts. Another benefit would be a saving of money. For example. 
If a certain Innovation made it possible to eliminate a lab for a course taught by 
traditional methods, the student would save the cost of the lab fee and the time 
^usually spent in lab each week. A final benefit might be the elimination of 
student tedium. In a traditionally taught statistics course, the student might be 
required to draw hundreds of numbers from a table of random digits to demon- 
strate a theorem about the binpmial or the normal distribution. This is a very 
tedious procedure which could be eliminated by a different course which had a 
computer-ba^ed support for generating random numbers, calculating means 
and calculating standard deviations. 

There are also several ways a teacher could benefit from an innova- 
tion. Overt benefits might be relief of tedium and increased innovation time. 
Covert benefits could be teacher satisfaction and increased prestige. The inno- 
vation may increase teaching efficiency and thus increase both the teacher's 
satisfaction and the student/teacher time in meaningful contact. This new method 
may give the teacher more free time which could be used for (1) develofJip^njt^^^^ 
of new courses , (2) enrichment of materials, and (3) enrichment of teaching. 
The last beneft could be relief of tedium. For an example, go back to the 
statistics example mentioned in student benefits. Using the traditional method 
of teaching, much of the teacher's time is spent working examples for students. 
This is tedious and often non-productive work. A computer-based support 
package which generated and worked example problems for students via a time- 
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sharing terminal could relieve the faculty members of tedium and see to the Indi- 
vidual student^s needs more effectively. This is not intended to belittle example 

I- 

problems, for they play an important role in the students* understanding of 
statistics. However, some students may need two examples to grasp a concept, 
while other students may need ten examples tp grasp the same concept. 

The benefits to the institution may be reduced costs, increased 

feculty morale, and increased student morale. The various ways that costs may 

/ 

be reduced were mentioned previously un^der budget requirements. However, 
in the case of computer-based Innovation, often the costs may be increased 
instead of decreased. This increased cost would need to be balanced or 
outweighed by student benefits and teacher benefits- Closely related to these 
student benefits and teacher benefits are increased student morale and increased 
faculty morale. One problem dealing with institutional benefits Is the lack of a 
means for objective evaluation of the benefits. 

Commitment of Supplier and Consumer 

This major category is based on two different parts. The commit- 
ment of the supplier to the consumer is in essence a "guarantee" such as a 
consumer might receive with any new product. The commitment of the consumer 
to the supplier is of a more indirect nature. Often a supplier will give away 
samples either free or at a reduced cost. This is for aid In the evaluation of 
the supplier's product and often carries some stlpulatlonfj to Insure a fair 
evaluation. This Is similar to the commitment of the customer to the supplier. 
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The commitment of the supplier entails areas such as speciaT^^ — 
materials, free consultatiorCfor special problems, aid In in-service training, 
and mechanisms for feedforward. The special materials aspect was discussed 
previously. Fre6 consultation might be In the areas of debugging computer 
programs or Implementation of the program on a different type of computer. Aid 
In In-service training covers instruction in use of special materials. The 
mechanism for feedforward is to inform users of potential problems and minor 
and major revisions or improvements. 

The commitment of the consumer Includes four different areas. 
These are (1) evaluation and feedback, (2) time, (3) manpower, and 
.(4) budget. The evaluation and feedback are very Important* The supplier 
will want to know about any potential problems such as computer programming 
errors. The supplier will want to be Insured of the consumer carrying out a 
fair evaluation, and he will want to be Informed of the results of that evaluation. 
The commitment of time is closely related to the evaluation. The evaluation must 
not be done until at least a fair amount of time has been devoted to the trial of the 
Innovation. Also, it would be expected that the consumer would budget a fair 
amount of manpower to the trial of^e innovation to give the innovation a 
better chance of success. The same argument holds for the budget commitment 
as for the manpower commitment. 

Implementation Procedures 

The last category is implementation procedures. It is not as 

r 

Important for the consumer's evaluation of the Innovation as it Is for the period 
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between evaluation and trial. Two variables suggested here were a Pert net- 
work and a time-sequencing chart. These would depict the tasks necessary to 
Implement the innovation along with a suggested order for carrying out the 
tasks. Some of those tasks could be in-service training, student orientation, 
securing the classroom, and securing the financing. 

The Questionnaire 

/ 

* / 
After the variables or factors were hypothesized, a sample of orj^ 

hundred and fifty-four administrators and faculty was chosen. They were 

chosen from forty-nine states, and their institutions ranged in size from junipr 

colleges to major universities. A questionnaire was then formulated and sent to 

each. The questionnaire was for a dual purpose. First, it Was to gauge the 

administrators' and faculty members' opinions and attitudes about the hypothe- 

sized variables. The second purpose was to allow the adn^fnistrators and 

faculty members to add any variables which they felt had been omitted. 

The questionnaire contained fifty-two items and a page for comments. 

It also contained two pages for bioo'-jphlcal information, information about 

Project C-BE, and information about the purpose of the questionnaire. For 

each of the fifty-two items there was a rating scale of Very Important, Important, 

or Less Important to be checked. Less Important was used to avoid the negative 

connotation of Unimportant. 

A total of fifty-eight (37.6%) questionnaires was returned. Of 

/ 

those, thlrty4even (63.9%) were returned completed, seven (12.0%) were 

/ 

return^unariswered, seven (12.0%) were returned unopened, five (8.6%) were 
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returned with missing data, and two (3.4%) were returned too late to be used 
in the analysis. 

The d3ta were then transcribed to computer cards and weighted, 
with a rating of Very Important having a weight of three, a rating of Important 
having a weight of two, and a rating of Less Important having a weight of one. 

The five questionnaires with missing data were not used In the 
analysis. The reason was that to give an unanswered question a score of zero 
was unfair since that would imply that the question was below Less Important. 
This may have been what the person Intended, but on the other hand he or she 
simply may not have understood the question. 

The questionnaire, along with the cover letter Is presented In 
Appendix A. Also included Is a listing of each respondent's answers and a 
percentage distribution of answers for each question. 




CHAPTER IV 
» ANALYSIS, RESULTS, AND CONCLUSIONS 

Introduction 

. Five methods of statistical analysis were used to analyze the data 
once it had been scored and transcribed to cards. Those were: 

1) Hierarchical Cluster Analysis ^ 

2) Non-Hierarchical Cluster Analysis 

3) Discriminant Analysis ^ 

% 4) A computer program called Testat 
5) Analysis by inspection. 
The analysis of the data was for determining which factors or variables were 
foremost in the prospective consumers' minds. The results of the analysis were 
then used in the design of a data collection form for developers of Innovations. 

Hierarchical Cluster Analysis 

Most hierarchical clustering techniques are "one of three general types" (4) . 
Those three types are: 

1) linkage methods 

2) centrold methods 

3) error sum of squares methods. 

This type of hierarchical cluster analysis used in this study was the Ward Sum 
of Squares Method* 
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Hierarchical Cluster Analysis is a classification technique which 



optimizes an objective function. At each stage two clusters are combined. The 
optimization of the objective function determines which two clusters to combine. 
Ward's method minimizes the .error sufn of squares. All hierarchical methods 
join the two "most similar" clusters at each stage. The only difference is the 
definition of "most similar." The tv^o "most similar" clusters of Ward's methods 
will be the two clusters which contribute the least to the total within group error 
sum of squares. 

It is necessary at this point to define several quantities which will 
be used in the mathematical treatment of our discussion. Bullock defines the 



following quantities in Section 3.3: 



iJk 



= score on the i^" of n variables for the 



j*" of m,. data units in the k*" of h- 



clusters 




'ijk 



mean on the i variable for data units 



in the k cluster 
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n "k _ p 

k , i=i j=i ^J*^ 

\ 

• " \ 

= error sum of squares for cluster k; sum of 
Euclidean distances from each data point 
' In cluster k to the centroidof cluster k; 

i 

within group squared deviation about the 
mean for cluster k, ' ^ 

n 

E = Z E. 

= total within group error sum of squares 
for the collection of clusters. 

The sinfiilarity between two clusters p and q Is defined as: 

MpM h _ _ 2 
^^P^ ^ Vq i=l ^^'"P " ^^^^ 

The most similar clusters are the two clusters which yield the smallest AE 

Bullock says "an important characteristic to notice" about this formula Is that 

A Epq is proportional to the squared Euclidean distance between the centrolds 

of clusters p and q* This is to be expected since x. and x are the 

»P iq 

th 

values of the I variable of the centrolds In clusters p and q respectively^ and 
n _ _ 2 

Z (X^p-X^-q) Is the formula for squared Euclidean distance. 
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Non-Hierarchtcal Cluster Analysis 

Non-Hierarchical Cluster Analysis is another muUhvarlate- 
classification technique. The four main methods of non-hierarchical cluster 
analysts are Forgy's method, Jancey's method, MacQueen's k-means method^ 
and Convergent k-means method. The method used was Forges method. 

Forgy's method allows two alternative types of Input. The data 
may be divided initially into hypothesized clusters or a selection of seedpolnts 
may be Input. The method used was the latter. Bullock gives a good treatment 
of the different methods for choosing seedpoints in Section 4.1* 

This method is a two phase method* The first phase consists of 
assigning each data unit to a cluster with the closest seedpolnt. The basis for 
determining closeness is the squared Euclidean distance of each data unit from 
the respective seedpoint. Phase two consists of calculating the new centrold for 
each cluster and then reassigning the data points to new clusters whose 
seedpoints are the previously calculated centroid. Phase two also keeps 
track of the number of data units which change each time. The clustering 
is completed when no data units change clusters. 

^The main disadvantage of non-hierarchical cluster analysis is the 
pre-suppositlon of the number of clusters . Another disadvantage is the 
necessity for either choosing seedpoints or dividing the data into clusters 
a priori. One big advantage, however, is that relatively few computations are 
required, even for large sets of data. Example output of Forgy's method is 
given in Appendix E. r 
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Discriminant Analysis 

Discriminant Analysis, according to Anderson (2), is a multi- 
variate statistical methiod whiicli yields a "linear function which has the greatest 
variance between samples relative to the variance with|n samples," 

Cooley and Lohnes (8) say Discriminant Analysis is a "procedure 

for estimating the position of an individual on a line tdat best separates classes 

i 

or groups. The position is determined by a linear function of the score." 
Multiple discriminant functions are computed as vectors associated with the 
latent roots of the "determlnantal equation" 

[ W/T - AI] = 0 . ' 

where I is the identity matrix and W is the pooled within groups deviation score 
cross-products matrix. A is the among-groups cross-products of deviations of 
group from grand means' weighted by grou^ sizes^ The matrix A is given by 
T-W where T Is the total sample deviation score cross-products matrix. 

The. elements of A, W, and T are given by'^he following: 

N 
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where g = rtunpber of groups 

Ng = number of subjects in group g 
N 1 = total number of subjects 

. ( ■ ■ 

, I and j range from 1 to p, where 
p = number of variables. 

Assumptions 

Several hypotheses about the data were made prior to the analysis 
of the data. The main hypothesis was that a "perfect" item would be one that had 
a mean srcore of 3.0 and a standard deviation of 0. The word Item will be used 
here synonymously with the word variable since each Item of the questionnaire 
dealt with one variable only. Thus a response to an item would be Interpreted 
as a response to a certain variable. This brings up the second hypothesis, 
which was that an important variable would invoke a "strong" response (i.e.. 
Very Important) regardless of whether the item had a positive or negative 
connotation regarding the variable. For example consider the following 
statements which give opposite connotations: 

1) The student has shown a marked increase In retention 
of knowledge using this new method. 

2) The student does not seem to retain knowledge as well 
with the new method as he did with the old method. 

The assumption says that either statement would Invoke a "strong" response, 
and this response would be directly related to retention of knowledge by the 
student, not to the positive or negative connotation of the Statement. 
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Analysis of the Data 



The first method of analysis used was the computer program called 



Teslat. This Is one of a set of behavioral science computer programs written by 
Donald J. Veldman (30) . This program Testat calculates the Pearson Correlation 
Coefficient (27) for each item versus the entire questionnaire, and also the 
Pearson Correlation Coefficient for each item versus the subgroup in which the 
Item was contained. However, using these two correlation coefficients, it was 
impossible to determine which items were "good" and which were "bad.'* Some 
Items with high means and low sigmas had low correlation coefficients also, 
while others with comparable means and sigmas had high correlation coefficients. 
The program also calculated means and standard deviations for each item and the 
percentage distribution of responses to each Item. It also calculated a consistency 
coefficient for each subgroup and for the total questionnaire. The formula for this 
consistency coefficient is 




where 



k 



number of Items in the scale 



item 



T 



Total (or Subscale Total) 



Cronbach (9) says that the consistency coefficient measures the 



homogeneity of a questionnaire and that "In a homogenous test, the items 



measure the same thing." He goes on to say that many feel that alpha is a 
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conservative estimate or lower bound on the coefficient of precision or reliability 
coefficient. However, he also says that "it is doubtful If testers have any 
practical need for a coefficient of precision. " This is probably true In our case. 
The questionnaire was not intended to be homogeneous, for each question was set 
up to elicit a response on one individual ftem or variable. It is very likely that 
a person would have opposite feelings about two different variables such as 
student retention of knowledge and the textbook required. It seems that this 
coefficient would be more applicable to a questionnaire which has "correct" and 
"incorrect" answers such as a test, rather than to a questionnaire set up to 
measure opinion. ; 

The next method of analysis used was one-dimensional Hierarchical. 
Cluster Analysis. The one variable used was the mean. It seemed that this was 
the important variable since the sigmas only ranged from 0.43 to 0.88. This is 
fairly small so that the tendency was to ignore the standard deviation. This was 
an error which was later realized and corrected. Since there were fifty-two 
data points. The Hierarchical Cluster Analysis started with fifty-two clusters 
and merged until it had only one cluster. The next step was to take the merge 
list and determine the order In which the clusters all merged and, therefore, 
what data points were in each cluster as they merged. This helped determine 
the natural breakpoints of the data — that Is, the points at which the data tend 
to separate into the groups which aVe most homogeneous. Figure 2 shows the 
ordered data and the way in which the clusters merged from five clusters down 
into two clusters. The breakpoints for the five clusters are at points that are 

r 

fairly easy to recognize since the difference in tlie mean above tiie breakpoint 
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and the mean below the breakpoint is greater than the difference between any 
two adjacent means In each cluster, excluding the last data point (question 11) . 
The input and output for the Hierarchical Cluster Analysis program are shown 
In Appendix D. 

the next step was to do Non-Hierarchical Cluster Analysis to 
confirm the Results of the Hierarchical Clustering. First, the clustering was 
done on one variable, the mean, into five clusters,, using seedpoints from'the 

i 

five clusters which had been determined by Hierarchical Cluster Analysis. The 
results were the same and came as no surprise, since the assumption of five 

clusters had been made and the seedpoints were drawn from those five clusters. 

i 

Sometimes, Hierarchical Cluster Analysis will yield erroneous results due to a 
phenomenon known as "linking." Then one-dimensional Non-Hierarchical 
Analysis into two clusters was done and once again the results were the same. 
The seedpoints were from the two clusters which ihlierarchlcal Analysis had 
given. There was a tendency at this point to classify the items in the first 
cluster as Important and the Items in the second cluster as Unimportant since 
the Items in the second cluster had .rnea.ns below 1 .90. However, this would 
have been very Incorrect, as will be seen later. 

Next, two-dimensional Non-Hierarchical Cluster Analysis on the 
fifty-two data points was tried using both the mean and the sIgma as variables. 
There was no change In the results In either the five clusters or the two clusters. 
This tended to reinforce the erroneous hypothesis that the sigma was unimpor- 
tant. The results should have been expected, however, since the magnitude of 



the means was from three to five times as large as that of the sigmas^/T able 1 
is a list of the questions, their'means and their standard deviations. 

• Discriminant Analysis was used next. The reason for using this 
technique is that is was reasonable to assume that there were two classes of 
questions, Important and Unimportant. Discriminant Analysis is a good method 
of dividing data when there are two distinct classes. Two variables, mean and 
Sigma, were used again. This analysis yielded some rather unusual information. 
Regardless of the breakpoint chosen for the two classes, the program was able to 
formulate a discriminant function which divided the data into those two classes 
with very few, if any, misclassiffcations. Seeking an explanation, the non- \ 
hierarchical clustering results were examined again. The examination of the 
five clusters revealed that the size of the clusters was almost the same, about 
ten, and also the total range of the means in e&ch cluster was about the same, 
which was 0.21 . A standard histogram of the number in each class versus the 
total range of each class (See Figure 3) showed the means to be uniformly distri- 
buted. Therefore, arbitrary breakpoints could be chosen anywhere and a 
discrimioation between the two classes could still be made. Example input and 
output for Discriminant Analysis is given in Appendix F. 

At this point it was realized that the tendency to divide the questions 
into the two classes mentioned previously was not valid based on the information 
that was available so far. So a more thorough analysis of the data was begun. 
Once again, a list of the questions, their moans and their sigmas, which had been 
ordered on the means from high to low, was examined. To this list for each item, 
the percentage distribution of responses was added. This percentage distribution 
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Figure 2. Hierarchical Clusters 
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was obtained from the previously mentioned Testat Analysis. Table 2 shows this 
list. Several things were Immediately apparent. First, the sigmas, as listed, 
seemed to be distributed from low to high to low. Se90ndly, there was a definite 
correspondence between the sigmas and the percerttage distribution trends. At 
the top of the list, the percentage distribution was skewed very definitely to the 
right. At the bottoift of the list the percentage distribution was skewed very 
definitely to the left. Finally, in the middle of the list, the percentage distribution 
approached a uniforjm distribution which accounted for the larger variances. 
Therefore, even thought the sigmas were small, they undoubtedly contained 
some valuable Information. The prior feeling that a mean of two or greater 
indicated a good or important Item, was incorrect. For example, an item whose 
distribution of answers was five for Very Important, twenty-seven for Important, 
and five for Less Impprtant would have a mean of 2.000 and a sigma of 0.528. 
Another item whose distribution of answers was twelve for Very Important, 
thirteen for Important, and twelve for Less Important would have a mean 
of 2. 000 and a slgma of 0.8185. it is easily seen, although the means are 
equal and the standard deviations differ by only .29 that the flrst item is a much 
better indicator than the second Item. Thus, It became apparent that some of 
the items with high variance or "poor" distribution should be lowered on the list. 

It was decided to use the percentage distribution numbers as 
variables also. To give all five variables equal status, the data was normalized 
(0,1) . This was done by computing a mean and a standard deviation for each 
column. Then using the formula ^ ^ " one- comes up with the 

transformed data of Table 3. 
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-.585 . 


-.213 


.799 


#672 


••511 


-.936 


1.190 


.352 


#614 


U002 


-.507 


-.213 


.7o9 


. #555 


••225 


-.819 


1.190 


.218 


#497 


• 468 


-.585 


.599 


.352 


#379 


-•549 


-.819 


1.781 


-.139 


#379 


-•Hi 


-.702 


1.'412 


-.050 


o321 


.174 


-.585 
-.194 


1.190 


-.050 


#262 


1.507 


-.213 


.352 


• 145 


• 545 


-.390 


.969 


-.139 


• 087 


1.116 


-.194 


.378 


-.050 


• 087 


••016 
• 031 


-.507 


1.559 


-.407 


• •031 


-.390 


1,559 


-.496 


• •031 


K497 


.040 


.009 


-.050 


-•148 


• 802 


-,077 


.821 


-.407 


-•148 


U497 


.ua 


.009 


-.139 


-•265 


1.116 


.118 


.378 


-.4o7 


• •382 


1.04Q 


,23b 


.378 


-.496 


-•382 


• 679 


,iia 


.821 


-.630 


••499 


.174 


,116 


1.190 


-.854 


-.558 


• 669 


,352 


.599 


-.764 


• •675 


• 488 


,469 


.599 
-1,985 


-.854 


«»#851 


2^354 


1,289 


-.273 


•#851 


-•083 


,547 


.821 


-1.122 


•#85l 


1.735 


1,094 


-1.173 


-.496 


«1#026 


.450 
.450 


.^»77 


-.213 


-.988 


•1#026 


-.213 


-.988 


-1.143 


1 .202 


1.406 


-1.39S 


-«764 


-1.204 


.479 


1.289 


-.804 


-.988 
-1.345 


-U204 


-.787 

.051 


.977 
1.^06 


.378 


•1.321 


-.804 


-1.122 


•]t380 


-.406 


1.406 


-.582 


-1.256 


•1^438 


•.454 


1.523 


-.804 


-1.256 


-1^497 


-.511 


1.601 


-1.025 


-1,256 


•1.673 


-1.824^ 


1.718 


-,804 


-1,479 


-1.673 


-1.824 


1.718 


-.804 


-lc479 


•2^024 


-1.748 


2.577 


-2.798 


-1.2S6 
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Table 3. Normal Ized Data 
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Using the five variables, Non-Hierarchical Cluster Analysis was 
applied to the transformed data. Using various seedpoints it consistently 
returned two clusters of size twenty-eight and twenty- four. Applying the same 
method to get three clusters, the elimination of three questions from the first 
cluster was made posslb!e. The three which were eliminated had a fairly high 
standard deviation. This left two clusters of twenty-five and twenty-seven 
which were ctesignated as Important and Unimportant. It was felt that there was 
more justification in this split than in the pre'Hous split of groups of thirty-two 
and twenty. Appendix E contains example input and output for Non-Hierarchical 
Cluster/ Analysis. ^ 

At this point It was decided to try Discriminant Analysis again, 
using/the transformed data and five variables. The results were the same as 
before with one exception. Now It was possible to hypothesize a breakpoint at 
any place in my list, and Discriminant AnalyiJis would provide a discriminant 
function and zero misclassifications. 

Results and Conclusions 
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After examining the non-transformed data, the questions were 
ordered In the first cluster, on the basis of the mean, sigma and the percentage 
distribution, from the most important to the least Important. Figure 4 gives this 
ordered list along with the variables contained In those twenty-five questions. 
The last twenty-seven questions could be ordered randomly since it would 
probably be more costly than it was worth to gather data related to those 
variables. 
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QUESTION VARIABLE 

21 \ Student retention of knowledge 
28 . Faculty costs per semester 

51 External computer resource requirements 

22 Student/Teacher time l^n meaningful contact 
36 - Special computer equipment requirements 
40 Budget Information , 

10 Availability of specl^al materials (co^mputer program) 

2 Objectives of the course 

31 Student morafe 

\ 

\ .18 Student interest 

35 Computer resources modification 

4 Modification of content and scope of course 

26 Instructor satisfaction 

30 Faculty morale 

33 ^ Addition to faculty 

48 Feedback mechanism 
46 Commitment of supplier 

29 Increased students per class 

39 Cost of course 

49 Feedforward mechanisms 
23 Faculty tedium 

41 Special materials 

20 Student Interest 

25 Preparation time for instructor 

Figure 4 

^ Important Variables 
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The first ten questions of the Important group, ordered as previous- 
ly mentioned are the following: 

The student seems to retain m\re knowledge when taught 
by the new method. 

The actual faculty cost per semester would be greater 
with this new course. 

What If the administration's unwilllngX^o consider external 
computer resources required? 

The student/teacher time In meaningful co\»tact seems to 
be increased by this new method, 

Special or addJtlonal computer equipment must be 
acquired to use this course. 

/ There is well documented budget Information at my 

' disposal. 

Special materials (I.e., computer programs) are 
readily available. 

The objectives and nature of the course can be 
altered' to meet our needs. 

Student morale would be greater if we adopted this 
new course. 

The student has greater Interest in the subject if 
It Is taught the new way. 

There seem to be three main factors in the important group. They 
are student benefits, costs, ,and faculty benefits. The student benefits and the 
costs far outweigh the faculty benefits. The number of Important Items relating 
to costs Is nine, and the number relating to faculty Is five. Two items relate to 
other areas. Out of the top ten Items, five relate to student benefits and five 

V 

; relate to costs. This is not much different from what was expected. The first 
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question on an administrator's mind is "Will this new method teach better?" The 
second thought is "How much is this going to cost?" the third question is "What 
benefits are there for me personally?" It is important to note that all three items 
are very interrelated and very important. If an innovation is not an improvement 
as far as student benefits are concerned, an administrator will haVe a difficult 
time justifying the additional cost necessary. And, finally, if he does not have 
faculty support, which comes partially from faculty benefits, the program will 
most likely be a failure. 

Data Collection Form 

The data collection form which follows was designed to give the 
developer of an innovation a form which is both easy to fill out and comprehensive 
In nature. It contains the important information for a prospective customer of an 
innovation. 
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DATA COLLECTION FORM 
1. Associate investigator (s) 



Office address ^Phone_ 

II. The title of the course is 



III. The topic of the course is_ 



IV. The objectives of the course ar'^; 

A. ' 

B. 

C. 

D. 



V. Please attach a course outline or syllabus to this form. 

» 

VI. List all student prerequisites and indicate whether they 
are suggested or required. Suggested Required 



C.. 
E. 



List by letter any prerequisites which could be taken care 
of by a remedial unit.. 
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VII.. List all required reference materials. 

A. 

B. _ 

C. 

D. ^ 

VIII. List all publications which exist in the open literature and 
describe the course. 

A. 

B. __ 

C. 

D. 

IX. Indicate which type(s) of teaching methodology are applicable: 

Yes NO 

A. Lecture type 

B. Self -paced 

C. In class exam (s) 

D. Take home exam(s) 

E. Discovery ^modules 

F. Incentive units 

G. Required labs 

H. Optional labs 

I. Review sessions 

J. Student tutorint 

Computer 

L. Other (attach explanation) 
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X* The following sections dealing with faculty and staff re- 
quirements, physical plant requirements, computer resource 
requirements, . special materials requirements, and expendi- 
tures are all dependent upon class size. Please give a 
relative clas? size to be used as a reference point. 
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The class size is 



XI. Fill in the blanks for faculty and staff requirements rela- 
tive to the previously estimated class size. 

A. The number of faculty needed to run this course is 



B. The number of proctors used is and the number of 

hours per week per proctor is . 

C- The number of graders necessary is , and the number 

of hours per week per grader is . 

XII. Fill in the blanks for physical plant requirements relative 
to the previously mentioned class size. 

A. The number of classrooms required is . 

B. The number of labs required is . 

C. The number of individual desks required per classroom 
is , and the number of tables per classroom is 

The number of drawing tables per classroom is 



Visual aid equipment is required. Yes No^ 

If "yes" please specify. _^ ^ 



E. sound equipment is required. Yes No_ 

If "yes" please specify. 



XIII. Fill in the blanks for computer-resource requirements rela- 
tive to previously mentioned class size. 

A. The number of teletypes required is . 

B. The number of graphics terminals required is . 

C. The course requires special plotting equipment. Yes ^No_^ 

I If "yes" please specify. 
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XIII* D. A mark sense reader is used in the course. Yes ^No 

E. The average amount of computer "line*' time per student 
is minutes. 

XIV* Indicate which special materials, if any, are necessary for 
this course. 

Yes No 

A. COTtputer programs 

The language they are written in 

is . 

B- Slide projectors 

C. Tape recorders or cassettes 

D. programmed texts 

E. Study units 

F. List any other special materials and an . explanation. 

(1) " 

(2) 

(3) , 

XV. Fill in the amounts on all the expenditure items which (1) 
pertain to your project and (2) you feel you can estimate 
fairly. The amounts should be for a one semester breakdown 
unless otherwise indicated. 

A. Estimated computer time expenditures 

B . Faculty costs 

C. Staff costs (teaching assts., graders 

proctors) 

^D. Cost of materials 

^E. Other (explain) 

F . Total of above items (one semester 

operating expenses) 



ERIC 



48 



XV. ^G. Computer equipment costs 

In-service training costs 
. I. Other equipment costs (explain) 



J. Printing costs 



_K. Preparation and shipping costs 
of materials 

L- Other , (explain) 



M. Total of above (one-time imple- 
mentation costs) 

XVI* Indicate which of the following method (s) of evaluation 
you use. 

A. Pre-test/post-test each student before and after 

each module. 

^B. post-test each student after each module. 

C. Analyze classroom examinations for student attain- 
ment of behavioral objectives. 
p. Other (explain) 



XVII. Student Benefits - Indicate which of the benefits listed 
below apply to your course and which can be documented by 
an evaluation method listed in Section XVI. 

A. Students learn more material. 

B. Students retain more knowledge. 

C. Students learn material better. 

D . Students spend less time per week in class. 

E. Students spend less time per week outside class. 

F. Costs for students are reduced. 
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' XVIII. 


Teacher Benefits - Give your subiective opinion of which 






benefits listed below apply to you due to your course. 






A. Teacher's efficiency is improved. 






B. Teacher's interest is hetahtened. 






C. Teacher's tedium is retirfeved. 






D. Teacher's free time is increased. 




- 


E. Other tanqible benefits fexplain) 






F. Other intanqible benefits fexplain) 




XIX. 


Indicate which of the following tasks need to be completed 






prior to the class being taught. If possijDle, indicate the 






estimated amount of time^ in some appropriate unit of measure- 






ment, needed to complete the tasks. 






Yes No Time 




1 


In-sprvice Training - ; 




1 
I 

I 


Secure Classroom and/or Labs 






Secure Financing 






Student Orientation 






Listing course in catalogue 






Printing of materials 






Securing computer equipment 






Order reference materials 






Securing other special equipment 






Hiring staff 






Securing student computer numbers 






Other (Explain) 






Other (Explain) 
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CHAPTER V 
EXTENSIONS AND RECOMMENDATIONS 

Introduction 

Where can one go from here? What further steps can be taken to 
further insure that an educational innovation will be accepted? Surely further 
work can be done in this area because there was virtually a void before this 
thesis « This is such an important area that research cannot be halted Tier e7 The 
opportunity exists for much more work* 

Extensions and Recommendations 

The most natural extension of this work would be to make the model 
a predictive model. This would have to be done after many projects had been 
accepted or turned down. One way to approach this is a survey of people who 
accepted projects and rejected projects. The data gathered from this survey 
could be analyzed by some form of statistical analysis to Identify the causes of 
acceptance or rejection using the same variables of this model. This statistical 
analysis might further reduce the number of Important variables and could 
yield coefficients for the variables. The main problem is that with twenty-five 
variables a large number of data points (projects rejected or accepted) v/ould 
be required to insure validity of the coefficients. Another advantage might be 
the recognition of the interdependence of the variables. These coefficients and 
variables, once known, could be used by the supplier of the technological 
innovation to maximize the model and thus the chance of acceptability. 

S3 



Another extension would be to try and determine the costs 
associated with gathering data for each of the variables of the model . In this 
way a project with a limited budget would know how to best gather data and 
which data was most profitable. If this extension were included in the extension 
mentioned previously, a coefficient might be deternriih^d for each variable such 
that if one know the relative value of each variable and the relative cost for 
obtaining data for that variable, one would know which data contributed the 
most to the value of the model as a whole. 

I recommend that as much work. as Is feasibly possible be done 
in this area, as the quality of our education in the future depends upon what 
we do now. We must not let good innovations be lost because the data necessary 
for success was not collected. At the same time, we must have a foundatrlon 
upon which to base our judgment of the merits and shortcomings of an 
educational innovation. 
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APPENDIX A 
Hypothesized Model 
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Hypothesized Model 



Nature of Course 

A. Course Objective 

B. Course Description 

1 . Course Content and Scppe 

2. Teaching Method and Pedagogical Approach 

3. Teaching Materials Available 

4. Reference Materials 

a. In Class Texts 

b. Outside References 

I* 

C. Detailed Course Outline 

D. Student Prerequisites 

E. History 

1. Previous Accomplishments 

2. Overall Evaluation 

3. Publications 
Benefits on a Comparative Basis 
A. Student Benefits 

1. Learning Efficiency 

a. Cost to Student per Semester 

b. Time Required per Weel< 

(1) In Ciass 

(2) Outside Class 



c. Amount of Material Covered 

d. Retention of Knowledge 
2. Student Interest 

a. Relief of Tedium 

b. Student Preferences 
Faculty Benefits 

1. Teacher Efficiency 

a. Student/Teacher time in meaningful contact 

b. Relief of Tedium 

c. Instructor Satisfaction and Rewards 

2. Increase Time out of Classroom 

a. For Enrichment of Materials 

b. For Enrichment of Teaching 

c. For Course Development 
Ijjstitutlonal Benefits 

1. Institution Efficiency 
a. Cost to Institution 

(1) Faculty Costs per Semester 

(2) Materials Costs per Semester 

(3) Computer Costs per Semester 

(4) Total Cost of Implementation 

2. Faculty Morale 

3. Student Morale 
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. Resource Requirements 

A. Faculty 

B. Computer 

1 . Type 

2. Time 

3. Capability 

C. Physical Plant 

D. Budget 

E. Materials for Teaching 
Commitment 

A. Supplier of Course 

1. Materials Available 

2 . Consultation Avai lable 

3. Aid in In-Service Training ' 

4. Mechanisms for Feedback 

5. Mechanisms for Feedforward 

B. Institution Commitment 

1. Manpower 

2 . Money 
3^ Time 

C. Faculty Commitment 
Implementation Procedures 

A. Pert Chart Plan for Change 

B. Tlme-secjuencing Chart for Tasks 
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THE UNIVERSITY OF TEXAS AT AUSTIN 
Project OBE 

Computer-Based Science and Engineering Education 
4l3 Ertgtrteerirtg Laboratory BuHdtng 
AUSTIN, TEXAS 78712 




DlR£CTOKS: 

Dr,lobnJ,Allan"t 
Dr. J, /. Lagowski 



Dear Sirs: 

I should like to introduce Project C-BE, a computer-based education 
project sponsored by NSF, at the University of Texas at Austin. This is 
a project^ for developing new computer aided curricula and computer- 
based supports for existing curricula. The enclosed literature provides 
additional information on Project C-BE* k 

Various manifestations of computing are used to enhance both the teachers* 
ability to teach and the students' ability to leairn. At present, a wide 
variety of courses in the Colleges of Engineering, Natural Sciences, 
Social and Behavioral Sciences and Humanities at The Uhiversity of Texas 
are supplemented, on the undergraduate level, by usfng' computer-based 



We are presently engaged in research regarding the inter-university and 
inter-college transferability and implementation of these innovative 
teaching techniques. . Our purpose in conducting this research project is 
to determine (1) what Information is essential for transferability and 
implementation of newly developed courses, and (2) what information is 
required by users in other institutions to assure success in the transfer 
and utilization processes. 



methods. 
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Therefore, we are asking you or your designated representative to fill 
out the attached questionnaire, and to return it by June 15, J 973, to 
assist us in our research. 

A copy of the final report will be furnished to you if you will check 
the box at the right of your name on the questionnaire. Thank you for 
assistance in this matter; we will look forward to an early and favorable 
reply. 

If you have any questions, please call me at (512) 471-3061, or my 
secretary Charlotte PolTard at (512) 471-4191. 



Sincerely, 




Randy WhTtehead 



RW:jl 
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PROJECT C-BE 



Project C-BE is a four-year project with a $1.3 million NSF budget which 
began in January, 1972. The effort is also receiving sizeable contributions 
from The University of Texas at Austin. The goal is to study the effects of 
computer-based instruction at a typical large university. 

\ . . 

Under the co-direction of Dr. John J. Allan^ Associate Professor of Mechanical 
Engineering, and Dr. J.J. Lagovvski, Professor of Chemistry, the Project is 
the first coordinated, massive assault using computer-based techniques ever 
attempted at one university. Professors in many fielcls, Jncludmg such areas 
V as various fields of engineering, chemistry, psychology, mathematics, physics, 

zoology, economics, home economics, architecture, and biology are partici- 
pating in the experiment. In addition to the approximately three dozen 
professors, 48 teaching assistants and 3,000 students in the five colleges will 
^ participate between January, 1972, and January, 1976. " 

• Today, the typical professor Is being swamped by ever-increasing numbers 
of students, and yet the students are very much in need of individualized 
instruction. With the use of the computer as a supplement to course material, 
the teacher can give the students much more individualized instruction, 
because he will have more time to actually interact with the students. Computer- 
based instructional techniques will assist the instructor in teaching large 
classes material which is more and more sophisticated. The computer is 
being used in both lecture and laboratory situations. 

In order to make the above changes a reality. Project C-BE must accomplish 
four goals which the National Science Foundation has set. First, the Project 
must identif/ common concepts that apply to many areas of computer-teased 
education. Second, methods of evaluating the economic and teaching 
effectiveness of using the computer as a basis for higher education also must 
be developed. Third, an administrator considering initiating computer- 
based techniques in his institution must know the pedagogical and financial 
investment his school would have to make. And, the fourth goal is to 
point out what must be present before computer-based materials can be 
transferred easily frorri one institution to another. 
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PROJECT C-BE 
PMOM - lIMlIll 
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COALS OF THE PROJECT 



Listed below are the four (4) objectives of our research as NSF views the 
effort. 

I . IDENTIFY COMPUTER-BASED CONCEPTS THAT ARE COMMON AMON G 
DISCIPLINES 

With reference to reactive terminals, computer graphics, labora- 
tory data acquisition, large-scale quizzing, and large-audience 
interactive lecture supplements--identify what concepts are common 
among the several disciplines. 

II. DEVELOP EVALUATION PROCEDURES FOR THIS TYPE EFFORT 

Develop procedures for evaluating the pedagogical and economic 
effectiveness and potential of computer-based techniques at the 
module, course, department, college, university, and national levels. 

' I 

III. IDENTIFY THE ELEMENTS OF TRANSFERABILITY 

Identify the elements that are critical to transferring successful 
educational packages and techniques from one institution to another* 

IV. D EVELOP AN IMPLEMENTATION MODE L 

Develop an implementation model so that administrators of 
institutions potentially using these techniques may view these 
techniques from the standpoints of investment, operating expense, 
comparative effectiveness, lead time, required attitude, etc. 
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BIOGRAPHICAL DATA 



1 . Name 



V 



2. Position 



3. Institution 



4. Teaching Experience years 
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Copy of Report Yes No 



5. Does your institution have computing facilities or access to computing 
facilities? 

YES NO 

If yes, please briefly describe the facilities and/or arrangements for use. 
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BIOGRAPHICAL DATA (Continued) 

6. If the answer fo #5 is no, do you anticipate the acquisition of facilities 
in the next 2 years? 

YES NO 

If not, the remainder of this questionnaire doesn't actually apply to your 

( 

institution, but we appreciate your cooperation and request that you re turn 
the quest ionnaire as is. 

7. Does your computing system have time-sharing capabilities? 

If not, could time-sharing capabilities be added to your present system? 

8. Does your institution or department use any courses utilizing the computer 
as a teaching aid^ such as CAI (computer aided instruction)? 



If so, please briefly describe each course and use of the computer. 



QUESTIONNAIRE 



Assume that you have been given all of the infor mation necessary to 

judge the merit of one of our computer-aided cou rses. Then, one at a 

time, assume the following statements are your conclusions, and rank them 
according to whether they would be (1) very important, (2) important, 
or (3) less important, in your consideration of transferring this project 
to your institution . 

1 . The objectives of the new course coincide with the objectives of a 
current course. 

2. The objectives and nature of the course can be altered to meet our need 

3. The content and scope coincides with a present course. 

4. The content and scope can be modified to meet our needs. 

5. The teaching method is similar to our methods. 

6. The pedagogical strategy is markedly different from ours. 

7. This innovation is a complete and self-contained course. 

8. This innovation is only of a supportive nature. 

9. This supportive innovation may be modified to support one of our 
present courses. 

10. Special materials (i.e., computer programs) are readily available, 

11. The text required is not the one used now. 

12. The outside references are not available in our library and must be 
specially purchased. 

13. The student prerequisites are fairly rigid. 

14. Adoption of this new course will cause some other courses to be 
eliminated due to duplication. 
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QUESTIONNAIRE (Continued) 

15. Another school (s) is already implementing the same cour?^. 

16. The time per week required of each student in class is/ess. 

17. The time required per week by each student outside class is more. 

18. The student has greater interest in the subject if ft is taught the new way, 

19. Not all students will like the new method. 

20. More students like the new course than the old course. 

21 . The student seems to retain more knowledge when taught by the new 
method. 

22. The student/teacher time in meaningful contact seems to be increased-- 
by this new method. 



23. This new method seems to relieve facuTty tedium. 

24. The time required per week of each teacher for in-class teaching is less. 

25. The outside preparation time per week for a teacher is more. 

26. The instructor satisfaction while using this new method seems to be 
heightened. 

27. The instructor rewards are intangible, and I might have a hard time 
locating an instructor interested in teaching the course. 

28. The actual faculty costs per semester would be greater with this new 
course. 

29. With the new method we will be able to teach more students per 
semester per section. 

30. Faculty morale would be greater if we adopted this course. 

31 . Student morale would be greater if we adopted this new course. 

32. This type of course will give added prestige to our department (college) . 

33. The adoption of this new course 'would necessitate the hiring of 
additional faculty members. 
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QUESTIONNAIRE (Continued) 

34. The course could be taught by a graduate student instead of a faculty 
member . 

35. Our computer (s) would require modification to handle this type of 
teaching aide. 

36. Special or additional computer equipment must be acquired to use this 
course. 

37. This new course would require additional classroom space. 

38. A special classroom would have to be set aside for laboratory use. 

39. The additonal cost involved does not justify one course, but we could 
split the cost by adopting three or four new, similar courses. 

40. There is well documented budget information at my disposal. 

41. All materials necessary are available for no royalty. 

42* This course wih have to be taught at least two semesters to get a 
fair evaluation* 

43. All the faculty may not favor adoption. 

44. A small amount of time is required for student orientatation to the course. 

45. The teacher of this ciass must be given relief time to orient himself 
with the new method. 

46. The C-BE and the University of Texas people are willing to provide 
consultation on special problems. 

47. The C-BE and the University of Texas people actually provide aid in 
in-service training of our faculty regarding this new method. 

48. There are well-established mechanisms for feedback in the event 
that we have problems. / 

49. There are well-established mechanisms for feedforward to inform us 
of future modifications and improvements. 



QUESTIONNAIRE (Continued) 



50. What if the administration's attitude is poor toward the use of student 
proctors, which the new course requires? 

51 . What if the administration is unwilling to consider external computer 
resources required? 

52. What if the administration is tied to traditional methods of teaching, and 
is not very open to innovative ideas such as this? 

53. Comments: 
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APPENDIX C 
Data From Questionnaire 
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Questionnaire 



Data 



1 
2 
3 
4 
5 
6 
y 

10 



numheh 
numbe« 

NUMPFH 11 

NUMBeK 12 

NUMOEH 13 

NUMPEH 14 

NUMBEH 17 

NUMbEK 18 

nombe^ 

NUMgFH 20 

NUMBeh 24 

NUMtJFH 25 

NUMOF« 26 

NUMbFH 27 

NUMBEK <9 

NUMBEK 30 

NUMBFrJ 31 

NUMCEH 32 

NUMfeEf^ 33 

NOMbEK 34 

NUMb£K 35 

NUMBeH 36 

NUMbEH 37 

NUMb£H 3d 

NUMBEf^ 39 

NUMbE'K 40 

NUMtJEH 41 

NUmBEK '*2 



332Jllil2?l2c;il223c'i'j222223^222211i3ll2J222^c:il22232 

2J2Jlll.-:->3l3i3ll 1J22J2213223333131 331322321132222311 
23?3iiii23in 31 1 13 132332133333333 1.^33333111112233231 
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TRANSFORMED UaTa - 2 CLUSHRS 

nE « 52 

NV « '5 

NC « .2 

NTiN a : 

NTOuT « 7 

minrEl » 

IPAR7 a i 
METHOD » -0 

REUUIREO STORAGE « lift WORoS 
ALLOTTED STORAGE » 5000 WORDS 

FOrOY method Of' CLUSTER ANALYSIS* DATA SET STORED ON TaPE 



IPaRt » li NUMBK ARRAY READ AS FOLLOWS 



& 29 

52 DATA UNITS MOVED ON ITERATION NUMBER 1 
SUMMED DEVIATIONS ABOUT SEED POINTS = 9.4000501 1E*01 

5 UATA UNITS MOVED ON ITERATION NUMBER 2 
SUMMED DEVIATIONS ABOUT SEED POINTS = 7,93l32595E*0i 

1 UATA UNITS MOVED ON ITERATION NUMBER 3 
SUMMED DEVIATIONS ABOUT SEEO POINTS » 7. 7ft945193E*0 1 

I UATA UNITS MOVED ON ITERATION NUMBER 4 
SUMMED DEVIATIONS. ABOUT SEED POINTS * 7.78590574F*0i 

1 DATA UNITS MOVED ON ITERATION nUmbER b 
SUMMED DEVIATIONS ABOUT SEED POINTS a 7.7fll 12874F*0i 

1 UATA UNITS MOVEU ON ITERATION NUMBER 6 
SUMMED DEVIATIONS ABOUT SEED POINTS s 7.77914993E*0i 

1 UATA UNITS MOVEU ON ITERATION NUMBER 7 
SUMMED DEVIATIONS ABOUT SEED POINTS = 7.7R771238E*01 

*^ 

1 UATA UNITS MOVED ON ITERATION NUMBER h 
SUMMED DEVIATIONS ABOUT SEEU POINTS s 7. 7fl82b91 SE*0 1 

0 UATA UNITS MOVED ON ITERATION NUMBER 9 
SUMMED DEVIATIONS ABOUT SEEU POINTS s 7. 79748028E*0 1 
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VARUtfLt «t*'«S HI G«OvP AN,, oi^FE«£'*C£ IN MgANS 
VAUXaoLC ^le**^ 1 *'EAN 2 UlFPEHE'^Ce 

I ,/V454 -.92?0« l.72l&^ 

3 -./t*S50 -2.702u« 

4 •tf»*3fr -..lo^iH ,S72/J 

5 .O^ll -.86l2i 3.5^9J£ 

SUM 0^ PROUOCTS 0£V» FmOH HSanS 

•>iV£«bp Oj- SUM Of Pf'O UCTS OF dEV. f^Om MpA.viS 

UJSCoiHlNiNT FUNCTION COEFf ICIEnTS 

U16625 -•02J95 *.?1?«8 *.*0000 
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O'JESTiONNAiRE ANALYSIS BY TESTAT 

PARAMETERS 

COL 1- 5 « 52 

COL 6-10 « 37 

COL 11-15 a 1004 

COL 16-20 » -0 

COL 2l-a5 « -0 

DATA FORMAT = {AlO»52Il) 



ITEM N 



1 2 
15.0U00 17,0000 



3 4 5 

9,0000 11.0000 52,0000 



MEANS 



1 2 3 4 5 

27.0^41 36.8919 20.5676 2l,621b 1 h.l35l 



SIGMAs 



1 

3.4715 



2 

4,9143 



3 

3.1153 



4 

3.8719 



5 

1 ,6l6t> 



ALPHAS 



1 

.5159 



2 

,780b 



J 

.6630 



4 

,7522 



5 

,826«J 
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MIS: The Management Information System 

To retrieve information usir^g MIS one needs only to properly 
identify that item or those items of information, using "key" words, which one 
seeks » To properly identify the information, the user of MIS needs (1) a list 
of "key" words, (2) an understanding of the data base organization, and (3) a 
syntax Into which the "key" words must be put. 

The "key" words are words or abbreviations which identify items 
of information. For example, the item "federal salary" could be identified by the 
key words SALFED, FEDSAL, or both words. A key word may be as long as 10 
alphabetical characters or as short as 1 character. The best size for key words 
Is between 3 and 7 characters since 10 character key words waste space and 
1 character key words lead to (1) misinterpretation of output or (2) erroneous 
retrievals. Neumonic key words are often used which makes the key words 
easier to remember and the interpretation of the output easier. 

The data base organization is similar to an outline. There are two 
types of relationships between the various items of data. There are explicit 
relationships and implicit relationships. Consider the information contained 
in the following outline. 
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I. Department - Number 1 - Electronics 

A. Manager is Jones. 

1 . First name is Tom. 

2. Salary is $1300. 

3. Age is 35. 

B. Employee is Doe. 

^ 1 . First name is John. 
( 2. Salary is $800. 
3. Age is 30. 

C. Employee is Smith. 

1 . First name is Joe. 

2. Salary is $500. 

3. Age is 27. 

11. Department - Number 2 - Shoes 

A. Manager is Johnson. 

1. First name is Howard. 

2. Salary is $700. 

3. Age is 37. 

B. Employee Is Wilson. 

1 . First name is Jane. 

2. Salary is $500. 

3. Age is 22. 

C. Employee is Smith. 

1. First name is George. 

2. Salary is $300. 

3. Age is 45. 
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John Doe and Joe Smith are directly or explicitly related to the Electronics 
Department. John Doe's salary is directly related to John Doe, but only 
indirectly or implicitly related to the Electronics Department. To put this infor- 
mation into a data base accessable to MIS, one needs only to decide on key words 
and enter the information correctly. It could be done in the following manner 
where key words are given in capitals and the information is in parenthesis. 

DEPT (01) TITLE (Electronics) $MCR (Jones) FIRST (Tom) SAL (1300) 
ACE (35) $EMPLY (Doe) FIRST (John) SAL (800) ACE (30) $EMPLY (Smith) 
fiRST (Joe) SAL (500) ACE (27) $# DEPT (02) TITLE (Shoes) $MCR (Johnson) 
FIRST (Howard) SAL (700) ACE (37) $EMPLY (Wilson) FIRST (Jane) 
SAL (500) ACE (22) $EMPLY (Smith) FIRST (Ceorge) SAL (300) ACE (^5) $# 

The separates information pertaining to the Electronics Department from the 
information pertaining to the Shoe Department. The separates the subgroups 
within departments. Thus the allows one to have the key word SAL within 
different subgroups a^d yet there is no ambiguity. 

Thus, the user of MIS needs to be given a chart such as the following one to 
retrieve information. The key words are given in capitals. 
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Department Number - DEPT 

A. Department Title - TITLE 

B. Manager - MCR 

1 . First name - FIRST 

2. Salary - SAL 

3. Age -ACE 

C. Employee - EMPL 

1. First name - FIRST 

2. Salary - SAL 

3. Age -ACE 

\ 

The user of MIS must also be g^ven the rules of syntax by which 
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his requests will be evaluated. A request td,MIS is made up of two parts. They 

are (1) an object clause and (2) a modifier^ clause. The object clause 

1 

indicates in a specified manner which items o^^ information are sought. The 
modifier clause helps MIS locate the correct inlprmation by adding constraints 
to the request. • 

I 

The object clause contains "objects!" in special configurations. The 

"objects" can be key words, integer numbers orjreal numbers. The simplest 

1 

object clause is made up of only one object. The! next simplest form is <;everal 
objects separated by AMD'S, where the total number of objects is less than or 

i 

equal to ten. The third form is several objects sejDarated by the arithmetic 
operators, +, and /. In clauses using the arithmetic operators, all pro- 

cessing is done left to right with no precedence relationships betvieen the 

36 



operators. In the case where an object has no numerical value, it is assigned 

] 

a value of zero. If this should cause division by zero, the error is non-fatal 
and the entire request is given a value of zero. More complicated forms of 
object clauses involve putting one of five simple commands before the object 
clause. Those five commands are: 

1) ALL 

2) TOTAL 

3) AVERAGE 

4) TOTAL ALL 

5) AVERAGE ALL 

When the ALL command precedes a normal object clause, MIS finds 
and locates all occurrences of each object subject to the constraints given in the 
modifier clause. The ALL command is not used with object clauses which 
contain arithmetic operators. 

The TOTAL command does exactly what one v^ould expect. That is, 
it totals all the values of the objects in the object clause. Once again, an object 
v;hich has a non-numeric value is given a numeric value of zero. 

The AVERAGE command acts exactly as the TOTAL command except 
that it divides the total by the number of objects. / 

The TOTAL ALL command is the combination of the ALL command 
and the TOTAL command. It totals all occurrences of the objects, subject to 
the constraints of the modifier clause. 

The AVERAGE ALL command is the combination of the ALL command 
and the AVERAGE command. It keeps track of how many occurrences of the 



88. 



O 



objects it finds which satisfy the constraints of the modifier clause. Then it 
totals all the objects and divides by the appropriate number. 

The modifier clauses are very important, for they enable MIS to make 

judgments while searching for information. The items denoted in our outline by 

\ 

Roman numerals are the main keys. . That is, they are directly or indirectly 
, related to any information contained in a group und^r any other Roman numeral. 
These majn keys are the most important modifiers and will be referenced either 
explicitiv or implicitly in every MIS request. In our case, tt^e^ain keys are the 
department numbers. They could be employee numbers, contract numbers, or 
anything similar. 

The modifier clauses are made up of two parts. These parts are 
FOR clauses and WMtRE clauses. 

The FOR clause tells MIS which main key we are referencing/ This 
saves a great deal of time in searching the data base. The simplest FOR clause 
is the word FOR followed by one main k^y. The next simplest is where the FOR 
is followed by up to ten main keys separated by AND's. If you have a request 
which references all the main keys, you can say FOR ALL. This is the default 
value if the FOR clause is left out^( 

The WHERE clause adds constraints in the form of ordered triples 

\ 

to the request. The first part of the ordered triple Is a key word. The next f5art 

\ 

is a conditional. The last part is a value either numeric or non-numeric. The 
three conditionals available are =, > , and < The ordered triples of 
the WHERE claui;e are evaluated before any other information is processed. 
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There can up to three ordered triple separated by either AND's or OR's. If 
an AND separates* the, triples, all the triples must evaluate true before the 
conditions are met. If the triples are separated by OR*s, the conditions are met 
when the first triple is evaluated true. Look again at the data base where certain 
groups are treated as complete erttities when considering a WHERE clause. For 
example, the modifier ctause. 

FOR ELECTRONICS WHERE MCR = JONES AND ACE = 27 
would be evaluated false and no information would be retrieved. 

There are several other aspects of MIS which need to be explained 
here. If the data base contains years they are treated as integer numbers. 
However, in the case of specific dates, a special convention is used to make 
processing easier. The date October 23, 1969, would be entered both in the data 
base and the request as the integer number 691023, when the first two digits 
represent the year, the second two digits represents the month and the last two 
digits represent the day of the month. 

If it is advantageous to use more than one key word to refer to 
Items of information, they will be put into the data base as follows: 

salfed/fedsal; 

If a request becomes long and takes more than one line, there Is a 
symbol which indicates this to MIS. Simply type a at the end of a line, and 
MIS knows to continue processing the request on the next line. 

The final convention can be valuable if it Is used with discretion by 
someone who knows the data base intimately. It is a form of abbreviation for key 
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words. If the key word is AGE, one can type A, AC, AGE, CE, or E, and the sarr 
information will be located, assuming that these combinations do not occur In any 
other l<ey words . 

Following this, there is a set of example outputs using the data 
base we hypothesized previously. Also there is a listing of the MIS program. 
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EXAMPLE OUTPUT OF MIS 



YOU ARE NO'-; COMMUNICATING IN REAL TIME 
WITH THE MANAGEMENT, INFORMATION SYSTEM 



WHEN YOU SEE THE ASTERISK^ TYPE IN YOUR 
QUESTION. IF YOU WISH TO TERMINATE THE 
COMMUNICATION, TYPE STOP 



*MGR OF 1 

DEPARTMENT # 1 
MGR = JONES 

*MGR AND SAL AND AGE OF 1 
• DEPARTMENT # 1 
MGR = JONES 

SAL = 1300 

AGE = . 35 

♦SAL/AGE+7000 OF 1 

DEPARTMENT # 1 
NUM = 7037.14 

♦SAL / AGE +7000 OF 1 WHERE MGR=JONES 
DEPARTMENT # 1 
NUM = 70137.M 

♦SAL/AGE+7000 OF 2 WHERE EMP=SMITH 
DEPARTMENT # 2 
NUM = 7006.67 

♦ALL EMPL OF 2 

DEPARTMENT # - 2 
EM^^L = WILSON 

EMPL = SMITH 

♦TOTAL SAL OF 2 

DEPARTMENT # 2 
SAL = 700 



TOTAL = 700.00 

♦TOTAL ALL SAL OF 2 

DEPARTMENT # 2 
SAL = 700 

SAL = 500 

SAL = 300 



TOTAL - 1500.00 

♦AVERAGE ALL SAL OF 2 

DEPARTMENT # 2 
SAL = 700 

SAL = 500 

SAL = 300 



AVERAGE = 500.00 
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♦AGE WHERE EMPLaSMITH AND FIRSTsQEORGE 
DEPARTMENT # I 
CONDITIONS NOT SATISFIED T F 1 

DEPARTMENT # 2 
AGE = A5 

♦TOTAL ALL SAL 

DEPARTMENT # ' 1 
SAL = , 1300 

SAL = 800 

SAL = 500 

DEPARTMENT # 2 
SAL = 700 

SAL = 500 

SAL = 300 

GRAND TOTAL = A100*00 
♦TOTAL ALL SAL OF 1 AND 2 
DEPARTMENT # 1 
SAL =5 1300 

SAL = .^00 

SAL = 500 



TOTAL - 2600.00 

DEPARTMENT # 2 

SAL = > 700 

SAL = 500 

SAL = . 300 



TOTAL = 1 500*00 

♦MGR WHERE DEP=1 

DEPARTMENT # 1 
MGR = JONES 

DEPARTMENT # 2 
CONDITIONS NOT SATISFIED 
♦DEPT WHERE TITLE=SHOES 

DEPT = 2 

♦77.77 OF 2 

DEPARTMENT # 2 
NirM = 77.77 

♦STOP 
STOP 
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